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EXECUTIVE SUMMARY 

It is currently estimated that over 60 percent of the life-cycle cost of a U.S. Navy 
submarine is attributable to operating and support (O&S) costs. This thesis attempts to 
develop a systematic method enabling decision makers and cost analysts to estimate the 
future annual O&S cost of a newly acquired U.S. Navy submarine. 

O&S cost estimates focus on the cost expected to be incurred by a major weapon 
system (such as a submarine) after it 1s acquired and deployed. Since there is currently 
no standardized method for producing reliable estimates of submarine O&S costs, this 
thesis sets out to formulate parametric cost models that can be used to determine the 
future annual O&S cost of newly acquired submarines based on assumed physical 
characteristics and manpower expectations. Similar methods were successfully 
developed for non-nuclear surface ships (Brandt, 1999). 

Source data for this cost analysis was obtained from the Naval Center for Cost 
Analysis’s VAMOSC (Visibility and Management of O&S Cost) database. The 
VAMOSC database contains historical O&S cost data spanning a period of 14 years for 
173 U.S. Navy submarines (as well as data on other types of Navy weapon systems). The 
data was normalized to constant 1999 dollars (CY99$), and was partitioned into two sets: 
fast attack submarines (SSNs) and ballistic missile submarines (SSBNs). SSNs and 
SSBNs were analyzed separately because of the differences in their missions and overall 
support structures. 

Graphical analysis and robust regression techniques were used to verify the 
assumption that the source data was free of temporal influences. After the data was 
validated, cost estimating relationships (CERs) were assumed to exist and were 
developed using standard regression and data analysis techniques for three presumed cost 
drivers — manpower, length and submerged displacement. However, the analysis 
revealed that there was no significant relationship between annual O&S cost and the three 
presumed cost drivers. More importantly, the analysis revealed that annual O&S costs 
are roughly the same across all classes within their respective category (SSN and SSBN). 

Therefore, an alternative method of estimating annual O&S cost was presented 
using probabilistic assessment of cost based on the empirical annual O&S cost distribution. 


The probabilistic assessment method allows decision-makers and cost analyst to estimate 


X1 


the annual O&S cost for which there is a desired probability that the true annual O&S cost 
of a new submarine will not be exceeded. For example, analysts can determine that, 
historically, 80 percent of all SSNs have experienced annual O&sS costs of less than $27 M 
(CY99$), while the remaining 20 percent have experienced annual O&S costs greater than 
$27 M (CY99$). So, loosely speaking, one can be approximately 80 percent confident that 
the annual O&S cost of a newly acquired SSN will be no more than $27 M (CY99$). 
Similar results can be obtained for any SSN or SSBN, and for any desired probability. 
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I. INTRODUCTION 


The decision to field a new weapon system, such as a nuclear submarine, 
requires a commitment to support that system for many years into the future. Decisions 
to develop, procure, and support new systems are based on many factors, one of which 
is the projected cost of the systems over their operational lifetime. Operating and 
Support (O&S) costs normally constitute a major portion of the system life-cycle cost 
and are critical to the evaluation of acquisition alternatives. 

The Department of Defense (DOD) will soon be spending billions of dollars on 
several new weapons systems, which include three new fighter aircraft, a new attack 
submarine, and a new fleet of surface combatants. Many of these weapon systems will 
cost at least twice as much as the systems they are designed to replace. 

To better manage cost, the decision-maker must focus on expenses associated 
with owning the weapon system, not just initial purchase price. For the Navy alone, 
estimates show that about 64 percent (OSD CAIG, 1992) of the life-cycle’ cost of major 
weapon systems can be attributed to O&S costs. In order to execute future modernization 
and acquisition plans affordably, the Navy (and DOD) must understand and manage the 
total ownership cost of weapon systems. For purposes of cost estimating, life-cycle costs 
are typically divided into four components: research and development, investment, 
Operating and support, and disposal. 

Figure 1 illustrates the program life cycle and shows the various levels of a 
system’s life cycle cost. The Figure is intended for illustrative purposes and may not 
depict actual program patterns. To show how the cost distribution can vary from one 
program to the next, Figure 2 provides a percentage breakout of the costs incurred during the 


key acquisition phases for two different weapon systems. 


' The life-cycle of a weapon system begins with the determination of a mission need and continues through 
the engineering and manufacturing development, production and deployment, and operations and support 
phases to the eventual disposal of the system by the government. 
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Figure 1. Illustration of Program Life Cycle Cost by Acquisition Phase (OSD CAIG). 

For purposes of cost estimating, life-cycle costs are typically divided into four components: research and 
development, investment, operating and support, and disposal. This Figure illustrates the program life cycle 
and shows the various phases of a system’s life cycle cost. The Figure is intended for illustrative purposes and 
may not depict actual program patterns. For the Navy alone, estimates show that about 64 percent of the life- 
cycle cost of major weapon systems can be attributed to O&S costs. 


The following paragraphs summarize the primary cost categories associated with 
each life-cycle phase. 


e Research and Development. Consists of costs incurred from program 
initiation at Concept Demonstration and Approval (Milestone I) through 
the Engineering and Manufacturing Development phase. Includes costs 
of feasibility studies; modeling; trade-off analyses; engineering design; 
development, fabrication, assembly, and test of prototype hardware and 
software; system tests and evaluation; system- specific support 
equipment; and documentation. 


e Investment. Consists of costs incurred during the Production and 
Deployment phase (from Milestone III though completion of 
deployment). Encompasses costs associated with producing, procuring, 
and deploying the primary hardware and directly associated hardware 
and activities, such as system-specific support equipment, training, data, 
initial spares, and military construction. 


e Operations and Support. Includes all costs of operating, maintaining, 
and supporting a fielded system. Encompasses costs for personnel; 


consumable and repairable materials; organizational, intermediate and 
depot maintenance; facilities; and sustaining investment. The O&S 
phase overlaps with the Production and Deployment phase. O&S costs 
are incurred in preparation for and after a system’s fielding and continue 
through the end of the system’s useful life. 


e Disposal. Captures costs associated with deactivating or disposing of a 
military system at the end of its useful life. These costs typically 
represent only a small fraction of a system’s life-cycle cost and are 
excluded from most analyses. The main exceptions (for which estimates 
must be provided) are disposal of nuclear waste, missile propellants, and 
other materials requiring detoxification or special handling. Note: this 
study does not attempt to quantify disposal costs of nuclear submarines. 


Investment 


F-16 Fighter 20% 


M-2 Bradley 
Fighting Vehicle 14% 





Figure 2. Percentage of Life-Cycle Costs Incurred in Various Program Phases (OSD CAIG). 
To show how the cost distribution can vary from one program to the next, this Figure provides a 
breakout of the costs incurred during the key acquisition phases for two different weapon systems. 
Disposal Costs were not available for this example. 


An appropriate O&S cost model should be able to estimate O&S cost early on in 
the Research and Development phase of the weapon system acquisition process. The 
proposed O&S cost model is parametric 1n that a statistical approach 1s used to estimate 


the functional relationship between cost and assumed major cost drivers”. 


2 : : : : 
~ Cost drivers are characteristics of a system or subsystem that have a large or major effect on the system's cost. 
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II. BACKGROUND 


A. OPERATING AND SUPPORT COST ESTIMATING 


Discussion on operating and support (O&S) cost estimating 1s obtained from the 
Operating and Support Cost Estimating Guide prepared by the Office of the Secretary of 
Defense (OSD) Cost Analysis Improvement Group (CAIG). As delineated in DOD 
instruction 5000.2M° and DOD directive 5000.4", the OSD CAIG acts as the principal 
advisory body to acquisition milestone decision authorities on cost-related issues. The 
guide, prepared by OSD CAIG, is for use by all DOD components, and, as stated 
explicitly in the manual itself, “should be considered the authoritative source document 
for preparing O&S cost estimates.” 

The life-cycle cost (LCC) estimate is an important tool for measuring 
affordability. For Major Defense Acquisition Programs (MDAPs), the LCC 1s composed 
of all costs related to a major weapon system during its life span; these include research 
and development (R&D), production, O&S, and disposal costs. As seen previously in 
Figure 1, O&S costs typically exceed both R&D and production costs over a system’s 
useful life. 

Therefore, in assessing the total cost associated with acquisition alternatives and 
affordability, the O&S cost for each system must be a primary consideration. Moreover, 
independent review and validation of O&S cost estimates is critical for informed 
decision-making about the procurement of major weapon systems that will require a 
financial commitment to O&S cost demands for many years into the future. The LCC 
estimate, which is required to support the planning, programming, and budgeting system 
(PPBS) among other things, serves as the basis for a program office’s budget submittal in 


support of specific milestone requirements for MDAPs. 


> "Defense Acquisition Management Documentation and Reports,” dated February 23, 1991. DoDD 
5000.2-M establishes procedures and formats for various acquisition-related reports, such as milestone 
documentation, periodic in-phase status reports, and statutory certifications. The manual is intended for 
direct implementation by the DoD components without supplementation. 

* "OSD Cost Analysis Improvement Group" (revised edition forthcoming). DoDD 5000.4 establishes the 
CAJIG and describes its responsibilities as the cost-estimating advisor to the DAB. It also establishes 
requirements for preparing and presenting estimates to the CAIG. 


In order to test the reasonableness of the program office’s estimate (POE) for 
LCC, an independent agency within the DOD cost community prepares a component cost 
analysis (CCA) or independent cost estimate (ICE). The CCA or ICE functions as a 
crosscheck for the POE at each acquisition milestone decision. 

In some circumstances, the OSD CAIG evaluates the CCA against its own ICE 
for the MDAP. Following its review, the CAIG submits its cost position to the Defense 
Acquisition Board (DAB), a senior DOD corporate body for major weapon systems 
acquisition that provides advice and assistance to the defense acquisition executive (the 
Undersecretary of Defense for Acquisition, Technology and Logistics) and the Secretary 
of Defense. The DAB makes the decision for each program milestone based on the cost 
position and other factors. 

The objective of this study is to develop a rough order-of-magnitude and robust 
O&S cost estimating methodology for U.S. Navy submarines that will generate reliable 


O&sS cost estimates for new submarine acquisition programs. 


B. THE NAVAL CENTER FOR COST ANALYSIS 


By direction of the Secretary of the Navy, the Naval Center for Cost Analysis 
(NCCA) was established on October 1, 1985. Its mission is to “to guide, direct and 
strengthen cost analysis within the department of the Navy; to ensure the preparation of 
credible cost estimates of the resources required to develop, procure and operate military 
systems and forces and support of planning, programming, budgeting and acquisition 
management; and to perform such other functions and tasks as may be directed by higher 
authority.”” NCCA is one of the four DOD cost centers that develop CCA’s and ICE's for 
MDAPs3°. 

One of NCCA’s vital functions 1s to manage the Department of the Navy's 
portion of the congressionally mandated Visibility and Management of Operating and 


Support Costs (VAMOSC) program. 


> The other three are the Army’s Cost and Economic Analysis Center (CEAC), The Air Force Cost 
Analysis Agency (AFCAA) and the DOD CAIG. 


c VISIBILITY AND MANAGEMENT OF OPERATING AND SUPPORT 
COSTS (VAMOSC) 


The Visibility and Management of Operating and Support Costs (VAMOSC) 
database is one source of historical cost data specifically directed by DoDD 5000.4°. An 
historical data collection system, VAMOSC records O&S costs in a well-defined, 
structured approach for most Navy major weapon systems (a U.S. Navy submarine is 
considered a major weapon system). 

One of the objectives of VAMOSC is to enhance the visibility of O&S costs for 
these systems for use in DOD cost analyses. Validated VAMOSC data should be used to 
calculate the O&S cost of MDAPs unless some other source of data is clearly more 
appropriate (OSD CAIG, 1992). The data is intended to be used as a basis for decisions 
conceming affordability, budget development, support concepts, cost trade-offs, 
modifications, and retention of current systems. The OSD CAIG, responsible for 
VAMOSC implementation and guidance, also encourages use of the data to develop cost 
estimates for future systems. 

The individual ship report (ISR) of the Navy VAMOSC database which was 
provided for this study forms the basis for the data analysis and cost model formulation. 
The estimated total annual O&S cost for each submarine is broken down into four 


primary component cost elements: 


direct unit cost (DUC) 

direct intermediate maintenance costs (DIC) 
direct depot maintenance costs (DDC) 
indirect cost (IC) 


Appendix A illustrates the complete cost element structure (CES) defined by VAMOSC. 
A summary description of the four primary submarine O&S cost components and their 
associated sub-elements follows from detailed discussion in the Navy VAMOSC 


Individual Ship Report (ISR). 


° DoDD 5000.4 requires that historical data be used to identify and allocate functional costs among major 
defense systems and subsystems. 


he Direct Unit Cost (DUC) 


Direct unit cost captures the direct costs associated with the operation and support 
of an individual submarine as identified by its unit identification code. It is computed 
within the Navy VAMOSC Management Information System. The major sub-elements 


of direct unit cost are: 


e personnel 
e material 
e purchased services 


A key sub-element in this aggregation is manpower cost. This cost includes base 
pay, allowances, other entitlements and government contributions to FICA and SGLI, but 
does not include the indirect cost of trainees, unassigned personnel, permanent change of 
Station personnel, patients, etc. 

Material cost sums the cost of all materials utilized or consumed by the ship with 
the exception of materials utilized in the intermediate and depot level maintenance effort. 
The materials accounted for herein include ship petroleum, oil and lubricants (POL), repair 
parts (non-aviation depot level repairables), supplies, and training expendable stores ’ 
(purchased from procurement appropriations). 

Purchased services cost covers the cost of services other than maintenance. These 
include printing and reproduction, ADP rental, contract services, rent, utilities, and 


communications. 


2: Direct Intermediate Maintenance Cost (DIC) 


Direct intermediate maintenance costs include the cost of material and labor 
expended by a tender, repair ship or equivalent ashore or afloat intermediate maintenance 
activity (IMA) in the repair and alteration of the submarine. The major sub-elements of 


direct intermediate maintenance costs are; 


’ Includes the cost of ammunition, training missiles, and pyrotechnics expended by the ship in non-tactical 
operations and training exercises. 


e afloat maintenance labor 

e ashore maintenance labor 

e material 

® commercial industrial services 


Computed within the Navy VAMOSC database, afloat maintenance labor cost includes 
the cost of labor expended by a tender, repair ship or equivalent afloat IMA for the repair 
and alteration of the ship being tended. Similarly, ashore maintenance labor cost covers 
the cost of labor extended by a shore IMA (SIMA). The cost of repair parts and 
consumables used by the IMAs are included within the material cost sub-element. 
Finally, commercial industrial services cost captures the cost of accomplishing afloat and 
ashore intermediate maintenance actions by private contractors due to workload 


limitations at the IMAs. 


3. Direct Depot Maintenance Cost (DDC) 


Costs associated with depot-level maintenance performed for the ship by public or 
private facilities are classified as direct depot maintenance cost. The major sub-elements of 


direct depot maintenance costs are; 


e scheduled ship overhaul 
e nonscheduled ship repair 
e fleet modernization 

e other depot 


These costs are computed within the Navy VAMOSC database, using data 
provided by various sources. The expenditures of scheduled depot maintenance support, 
for Regular Overhaul (ROH) and Selected Restricted Availability (SRA), of ships in the 
operating forces incurred at both public and private facilities constitute scheduled ship 
overhaul cost. Nonscheduled ship repairs cost, in contrast, records the cost of depot-level 
maintenance expended as the result of casualty, voyage damage, and other unforeseeable 
occurrences which remain beyond the repair capability of the ships force. | 

Fleet modernization cost sums the costs of installing ship alterations and 


improvements (including military and technical), other support provided at ship depot 


facilities, and costs for centrally provided material used at public and private facilities. 
Costs expended for the purchase of spare parts and other material required due to changes 


in the ships Consolidated Shipboard Allowance List are also included. 


4. Indirect Costs (IC) 


Indirect O&S cost captures the cost of those non-investment services and items 
that are required by the ship after commissioning and launching to continue operations 
but which do not result in an expense against Fleet Operations and Maintenance, Navy 


(O&MN) appropriations. The major sub-elements of indirect operating and support 


costs are; 
e training 
e publications 
e engineering and technical services 
e ammunition handling 


These costs are computed within the Navy VAMOSC database, and are calculated by the 
summation of cost sub-elements of training (professional skill classroom instruction for 
officers and enlisted), publications, engineering and technical services (services provided 


to the submarine other than during IMA or depot availability), and ammunition handling. 
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I. DEVELOPING A PARAMETRIC COST MODEL 


A. THE PARAMETRIC COST ESTIMATING PROCESS 


1. Collection, Normalization, and Evaluation of Historical Cost and 


Parametric Data 


Parametric cost estimation requires an extensive database of historical cost. The 
VAMOSC database offers the advantage of actual observations which show both 
expected and unusual cost expenditures of fielded systems 

The cost data must be normalized to account for environmental impacts such as 
inflation. Additionally, the data must be transformed into a format suitable for analysis 
and a partitioning of the data into two types, SSN and SSBN type submarines for 
consistency of scope (sample homogeneity). After the historical data is normalized (ex. 
inflation), data analysis and regression will be used to evaluate the assumption that O&S 
costs are constant from year to year within any class so that the class average and its 
associated variance can be used in formulating a CER. It 1s assumed that there exists a 
functional relationship between cost drivers and O&S cost. A cost driver or parameter 1s 
simply a physical, performance or technological characteristic that is used to predict cost 
at a high level of aggregation: a "top -- level" cost estimate. The nature of this 


relationship will be determined through regression analysis. 


2. Cost Estimating Relationships 


Cost estimating relationships (CERs) are “... mathematical expressions relating cost 
of a dependent variable to one or more independent cost driven variables.”” (Parametric 
Cost Estimating Handbook, 1995) There are four common approaches to developing a 


CER: 


Analogy 

Industrial Engineering approach 
Expert Opinion 
Statistical/Parametric approach 


Il 


The statistical or parametric approach is generally the preferred method of cost estimation 


and 1s used in this thesis 


B. THE PROPOSED TOTAL ANNUAL O&S COST MODEL 


A parametric cost model is defined as “... a group of cost estimating relationships 
(CER's) used together to estimate entire cost proposals or significant portions thereof” 
(Parametric Cost Estimating Handbook, 1995). Parametric cost models link O&S cost 
with the major weapon system’s physical, performance, and technical parameters. It is 
assumed that a cost estimating relationship exists between a size parameter and O&S 
cost. Cost is represented by the expenditure of total annual O&S dollars. Here the major 


weapon system 1s a submarine. 


1. Cost Model Methodology 


This study attempts to construct a parametric cost model for estimating total 
annual O&S cost for U.S. Navy submarines based on one of the three specific size 
(physical) parameters: submerged displacement (tons), length overall (LOA) in feet, and 
manpower (crew size). A historic cost database detailing the total annual O&S cost of 
175 submarines 1s normalized for inflation, purged of submarine classes that are non- 
nuclear and evaluated for consistent cost trend relationships (using graphical techniques, 
linear regression and robust linear regression). CERs will be applied to the two 
submarine categories (SSN and SSBN) to obtain a rough order-of-magnitude O&S cost 
estimate. 

The model will also provide total O&S cost broken down into four primary OSD 


CAIG O&sS cost components for each category. 


Nag Cost Model Documentation and Validation 

The documentation of a parametric model should include the source of data used 
to derive the parameters, the size and range of the database. Additional information that 
should be included 1n the documentation of a parametric model is: how the parameters 
were derived, the limitations of the model, the time frame of the database, and how well 


the parametric model estimates its own database. 
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IV. DATA ANALYSIS 


A. DATA COLLECTION AND NORMALIZATION 
The VAMOSC submarine data was provided by NCCA in a spreadsheet format 


(see Appendix A for a sample of the raw data). The data reflects annual O&S cost from 
fiscal year 1984 through 1997. Two classes in the database were non-nuclear powered 
submarines and were subsequently excluded since the scope of the study extends only to 
nuclear-powered submarines. SSBN 598 class was removed from the study because it 
had only one observation point and was missing data. The SSN 640 class, two special 
operations boats converted from an SSBN 640 class hull, was missing numerous entries 
and was therefore removed from the study. The purged database contains O&S costs for 
175 submarines spanning 13 classes. All cost data received in the database was 
normalized to constant 1999 dollars (CY99$) to remove the effects of inflation. Table | 
summarizes the database in terms of submarine class, the number of submarines in the 


class, years of data and comments. 


Submarine # in Years Comments 
Class ae of Data 


Se Se Removed/Non-Nuke 
SS 580 Removed/Non-Nuke 
SSN 575 

SSN 578 

SSN 585 

SSN 594 

SSN 597 

SSN 608 

SSN 637 

SSN 640 Removed/Data missing 
SSN 671 

SSN 685 

SSN 688 

SSBN 598 Removed/1 year of data 
SSBN 616 

SSBN 640 

SSBN 726 


Table 1. Submarine Database Summary. The data 1s summarized by 
submarine class, the number of submarines in the class, years of O&S cost 
data and why some classes were removed from the analysis. Although the 
SSBN 616 and 640 classes have the same physical size parameters they are 
significantly different internally and are considered separate classes. 
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Observations in this database consist of the O&S cost associated with a particular 
submarine in a particular year. In each observation, the total annual O&S cost is broken 
down into 122 cost elements in accordance with the VAMOSC Defined Cost Elements 
Structure (CES). For a complete breakdown of this structure see Appendix A. For this 
Study the 122 CES’s are aggregated into the four major cost components, as discussed in 
chapter 2, representing the total annual O&S cost. A detailed review of the database 
revealed continuity in all CESs across all years with the exceptions noted above. 

The scope of the database is further refined into two categories. The 13 classes of 
submarines can be partitioned into SSNs and SSBNs. This analysis will consider all 
submarines that are not ballistic missile submarines as fast attack submarines because 
research and one-of-a-kind classes more closely resemble SSN characterization. This is a 
natural partitioning of the set of all submarines because of differences in mission, 
maintenance and crew makeup between the two. The two categories will be analyzed 
separately to achieve parity of content and consistency of scope. For brevity, the three 
largest classes within each category, which constitute 93% of all SSN observations and 
100% of SSBN observations, are presented for in this chapter. These classes are SSN 
594, 637, 688, and SSBN 616, 640 and 726. 


B. ASSUMPTIONS VALIDATION 


A Assumptions 
Since the development of the predictive cost model is based on all annual O&S 
cost observations from a class, the first step of the data analysis is to validate two 


assumptions. Specifically, for a given ship class: 


e on average, annual O&S cost for any submarine within a class does not 
change from year to year; and 

e the collected annual O&S cost observations can be viewed as coming from a 
random sample drawn from a hypothetical population of such submarines. 


In consideration of the first assumption, we might logically think that as a 
submarine grows older, maintenance and upkeep costs should increase, which is one 


possible indication of time-dependent behavior, however, that was not found to be the 


14 


case. For the second assumption, although the VAMOSC submarine database reflects the 
entire population of Navy submarine classes, the collected database 1s viewed as a sample 
of submarines taken from the entire population of possible past, present, and future 
submarines for purposes of this analysis. This allows us to use the tools of statistical 
theory to assess the significance of different factors. 

Effectively, the objective of the graphical analysis and regression analysis in the 
initial stage of the cost model development is to validate the assumptions that class O&S 
costs within each class are approximately constant over time and that the O&S cost for 


each submarine in a class is indistinguishable, year to year, from others in that class. 


C; GRAPHICAL ANALYSIS 


The graphical analysis is an exploration of the database to help understand the 


character of the data and help clarify and interpret our findings. 


iL. Scatter Plots 


Scatter plot analysis of O&S costs over time will develop a visual feel of how 
O&S costs vary over time. Figure 3 shows the scatter plots for the six classes of 
submarines identified earlier. The scatter plot uses the submarine’s hull number to 
denote an observation. This helps to conclude that individual submarine O&S costs are 
indistinguishable, year to year, from others in their class. All of the classes show a 
significant amount of scatter predominantly in the higher cost areas. 

The SSN 594 and 637 and SSBN 616 and 640 classes show many extreme O&S 
cost observations. These extreme O&S cost observations are scattered significantly above 
the bulk of the observations and tend to decrease over time. It appears that as submarines 
from these classes were decommissioned, the number of extreme observations decreased 
rapidly and converges to the bulk of O&S cost observations for these classes. This runs 
counter to the idea that O&S costs would tend to increase over time due to years of 
service. These classes were being decommissioned during the time frame of the database. 
The SSN 688 class has extreme observations more uniformly distributed over time. This 
class of submarine has experienced some decommissioning but not to the extent that 


others have. 
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Figure 3. Scatter Plots of O&S Cost and Submarine-Year Depicted by Hull Number. All six classes 
show significant amounts of scatter predominantly in the higher cost area. Use of the submarine hull 
numbers to depict the O&S cost observation for that year helps conclude that individual submarine O&S 
costs are indistinguishable, year to year, from others in that class. The 594, 637, 616, and 640 classes, now 
retired, show a decrease in extreme O&S cost observations as the class nears retirement. The 688 class 
shows a more even distribution of extreme observations and the 726 class shows an increase In extreme 
observations as the class enters the fleet. Extreme observations appear to be a normal part of submarine 
O&S costs, and may be due to reactor refueling. 
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The SSBN 726 class shows the opposite of this effect. As more 726 class submarines 
come online the number of extreme observations increase. The overall synopsis is that 
all classes of submarines have extreme observations which appear to be a natural 
component of their O&S costs but the frequency of these observations decrease 
significantly when the class approaches retirement. It 1s suspected that these extreme 
observations are related to reactor refueling. 

However, as a class comes on-line through commissioning these extreme 
observations increase. These extreme O&S cost observations (outliers), which will be 
shown later, are primarily a function of direct unit cost and direct depot maintenance cost. 
The next step will be to use histograms to see how O&S costs are distributed within a 


class. 


2. Histograms (Total O&S costs) 


The distribution of cost within a class will give us a better indication of where the 
average O&sS costs lie and see how the extreme observations are distributed. The 
histograms in Figure 4 shows the number of O&S cost observations that falls within an 
O&sS cost dollar range or bin. For example a submarine that was in operation from 1984 
to 1997 will contribute 14 O&S cost observations and each observation based on its cost 
will be assigned a bin. All the histograms are skewed to the right and show that most 
submarines have an annual O&sS cost well below $50 M. 

Although the bulk of the O&S cost is below $50 M there are observations that are 
well above $50 M, corresponding to the extreme observations identified in the scatter 
plots earlier. We also notice that there are more extreme high-cost observations than there 
are low-cost observations relative to the average. This also shows that the extreme 
observations are not evenly distributed on either side of the average but reside 
predominantly above the average. The extreme observations are quite far away from the 


bulk of the data and could have a significant effect on our regression analysis later on. 
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Figure 4. Histogram Plot of Annual O&S cost and Observation counts. All the histograms are 
skewed to the night corresponding to the large number of extreme O&S cost observations shown in the 
scatter plots. The majority of the O&S cost observations are well below $50 M. The extreme 
observations will have a significant effect on the regression analysis later on. 
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3: Component O&S Costs by Percentage 


O&sS costs will be decomposed into four major components and transformed into 
a percentage of the total O&S cost to see which component contributes the most to the 
extreme observations. The graphs in Figure 5 sum each of the four component O&S 
costs for all submarines in a class and year and then divide each component cost by the 
total O&S cost for that class and year. This provides a snapshot, by percentage, of how 
the total O&S cost is distributed among the four component costs. It is interesting to note 
that direct unit cost and direct depot maintenance cost make up the largest percentage of 
total O&S costs. 

For the SSN 594 and 637 and SSBN 616, and 640 classes the direct depot 
maintenance cost component commands a higher percentage of the total annual O&S 
costs early on and then drops off taking a lower percentage of the total O&S costs. Recall 
that the extreme observations for these classes were also decreasing over time. It will be 
shown later that direct unit costs are fairly constant over time so that the apparent 
increase of direct unit cost as a percentage of the total O&S cost is because direct depot 
maintenance costs decrease sharply overtime. It appears that as a submarine class reaches 
the end of its useful life and begins retiring, by decommissioning its units, direct depot 
maintenance cost will command a lesser share of the total O&S costs. 

The SSN 688 class shows a fairly steady percentage of the direct depot 
maintenance cost then shows a decrease in the last few years when a number of its units 
were decommissioned. The SSBN 726 class shows a completely different picture in that 


direct unit cost takes the lion’s share of the total O&S costs for that class from the onset. 
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Figure 5. Four Major Component Costs Broken Out as Percentages of the Total O&S Cost. The legend is 
as follows, Diamond for direct unit cost, Square for direct intermediate maintenance cost, Triangle for direct 
depot maintenance cost and X for indirect cost. The four major component costs (DUC, DIC, DDC and IC) are 
shown as a percentage of the total O&S cost for a submarine-year. DUC and DDC are the major contributor to 
the total O&S cost. The 594, 637, 616 and 640 classes show that DDC dominates DUC as the major contributor 
to annual O&S cost but as the classes are retired it takes on less importance. DUC becomes the major 
contributor not because it increases in cost in later years but because DDC decreases rapidly, which will be 
shown later. The 688 class shows DDC dominating DUC but takes a dip when some of the 688s were 
decommissioned. The 726 class shows the opposite with DUC dominating DDC. 
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4. Direct Unit and Direct Depot Maintenance Costs by Average 


A further look into the average sub-component costs will be conducted to 
determine what component and sub-component influences the extreme O&S cost 
observations. Figures 6 and 7 examine the average direct unit costs and direct depot 
maintenance costs. Each sub-component is summed for all submarines in a class and 
year and divided by the total number of submarines in the class that year. 

The sub-components of direct unit cost for the SSN 594 and 637 and SSBN 616 
and 640 classes tend to be constant from year to year. The explanation for the extreme 
observations is in the direct depot maintenance cost component, which includes 
scheduled ship overhaul and fleet modernization sub-components. Also, as the class is 
retired this component’s average is not constant over time but decreases significantly. 

The SSN 688 class shows constant averages across the sub-components of direct 
unit cost and a slight decrease in scheduled ship overhaul. 

The SSBN 726 class is completely different from the rest. The direct unit cost 
component is not constant as submarines of the class are coming on line. This could be 
contributed to the material sub-component of direct unit cost. The direct depot 
maintenance cost is not constant either. The extreme observations for the 726 class are a 


result of both the direct unit and direct depot maintenance cost component. 
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Figure 6. SSN O&S Sub-Components, DUC and DDC, Averaged by Total Number of 
Units in a Submarine-Year. The Average DUC for all three classes are constant from year 
to year regardless of class retirement or decommissioning. Average DDC is anything but 
constant from year to year, sharply decreasing for retiring classes 594 and 637 and mildly 
decreasing for the 688 class which has some decommissioning activity in the later years of 
the data. The sharp decrease in DDC coincides with the decrease in the extreme observation 
see earlier. Its clear that DDC is what drives the extreme observations in submarine O&S 


cost. 


22 


SSBN-616 Class Average DUC and DDC ee: 




















mi98s 
Breakout 011986 
01987 | 

| 
40 my 1988 
11989 
g9 1990 
— 30 : 1991 | 
= WB 1992 
= B31993 

Jl 

w £31994 
fe) : 
O 10 
ee | 
O =a Pie 3 


DIRECT UNTT COS Ts DIRECT DEPOT MAINTENANCE 





1984 


SSBN-640 Class Average DUC and DDC = 


Breakout £91986 | 
£31987 


50 m 1938 
1989 

aa en a0: 
1991 
me 1992 


——— E1993 


£31994 


3 
3 
_ ies ; 


DIRECT DEPOT MAINTENANCE 










A denes rate rapes Pepe eR NIN Bret 


maken 9. 


Cost ($M) 








DIRE CIeUNINeS Ost S 





SSBN-726 Class Average DUC and DDC Ses 


£31986 
Breakout 1987 


1988 
£1989 
m1990 
01991 
M1992 
£91993 
£31994 

M1995 
M1996 


pr |e 1997 | 


DIRECT DEP OT MAINTENANCE 


oO) 
=) 


oe | 
° a Sa 
or 

ut 


DIRECD UNIT COSTS 























Cost ($M) 


Figure 7. SSBN O&S Sub-Components, DUC and DDC, Averaged by Total Number of Units in a 
Submarine-Year. The Average DUC for the 616 and 640 classes are constant from year to year 
regardless of class retirement. Average DDC is anything but constant from year to year, sharply 
decreasing for retiring classes 616 and 640. The sharp decrease in DDC coincides with the decrease in 
the extreme observation see earlier. The 726 class shows that both DUC and, to a lesser extent, DDC are 
not constant over time. Its clear that DDC is what drives the extreme observations in the 616 and 640 
class O&S cost and primarily DUC for the 726 class. 
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=. Regression Analysis 


Regression analysis will be used to determine whether average O&S costs are 
approximately constant from year to year. If the assumption is correct, the analysis 
should result in a regression line with a zero or near zero slope. However, as shown 
earlier the data contains many extreme observations which heavily influence OLS. 
Additionally, we have observed that the histograms are all skewed toward the right, 
indicating that one of the assumptions of OLS, that the errors are normally distributed 
might be violated. The influence of extreme observations will tend to overestimate and 
pull the OLS regression line towards them. 

Robust regression (Mathsoft, 1999) techniques are an important complement to 
the classical ordinary least-squares (OLS) technique in that they provide answers similar 
to the OLS regression when the data are linear with normally distributed errors, but differ 
significantly from the OLS fit when the errors don’t satisfy the normality condition or 
when the data contain significant outliers. The Robust regression ts influenced by 
outliers but to a lesser extent than traditional regression. Figure 8 demonstrates this 
effect by comparing an OLS fit (S-PLUS 2000 function /m( ) (Mathsoft, 1999)) and a 
Robust fit (S-PLUS 2000 function rreg( ) (Mathsoft, 1999)) with the 671 class data, 
which has only one submarine. Because the extreme observations are in the middle of 
the data the OLS fit is pulled toward them like a bar being lifted in the middle to keep its 
balance. The Robust fit provides a lower estimate of the O&S cost over time and will be 
used for this analysis. Figure 9 compares OLS and Robust linear regression for the six 
classes being described. 

The Robust fits appear to have a zero or near-zero slope indicating annual O&S 
costs are constant from year to year. The OLS fit shows indications of a negative slope in 
all but one case. If the extreme obsérvations were consistently distributed throughout 
time, the OLS fit would parallel the Robust fit but be shifted up toward the extreme 
observations. In this case because the direct depot maintenance cost decreases 
dramatically when a class nears retirement, the OLS fit gets rotated toward the 


decommissioning years where there are fewer extreme observations. 
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Figure 8. Comparison of OLS and Robust Regression for SSN-671. Robust regression techniques 
provide answers similar to the OLS regression when the data are linear with normally distributed errors, 
but differ significantly from the OLS fit when the errors don’t satisfy the normality condition or when the 
data contains significant outliers. The Robust regression 1s influenced by outliers but to a lesser extent than 
traditional regression. This figure demonstrates this effect by comparing an OLS fit and a Robust fit with 
the 671 class data, which has only one submarine. Because the outliers are in the middle of the data the 
OLS fit is pulled toward the outliers like a bar being lifted in the middle to keep its balance. The Robust fit 
provides a lower estimate of the O&S cost over time and will be the used for this analysis. 
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Figure 9. OLS and Robust Regression Plots. Both The OLS and Robust regression lines are 
displayed but only the robust fit will be analyzed. The Robust fits appear to have a zero or near-zero 
slope indicating annual O&S costs are approximately constant from year to year. The OLS fit shows 
indications of a negative slope. If the outliers were consistently distributed through out time, the OLS 
fit would parallel the Robust fit but shifted up toward the outliers. In this case because the direct depot 
maintenance cost decreases dramatically when a class nears retirement, the OLS fit gets rotated toward 
the decommissioning years where there are fewer outliers. This affect is opposite for the 726 class. 


Table 2 shows how the Robust regression line fits the data. The predictive measures are 
the slope of the line, intercept, standard error (SE), coefficient of determination (R°), and 


t statistic. 
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Table 2. Robust regression predictive measures. Al] the slopes of the regression lines are 
very near zero or are insignificant. The R’s at best show no better than .17 which means the 
regression line explains very little of the variation in the data. 


The slope of the regression line indicates how much the average annual O&S cost 
changes from year to year and although the slope is not zero, it 1s very close to zero for 
all but the 616 class. Shortly, the hypothesis that the slopes of the lines in the 
hypothetical population are zero, will be tested. Since the SE measures the average 
estimating error when using the model, the smaller the error, the better the fit. Here we 
see that the errors are on the same order of magnitude as the estimated slope coefficients. 
R° is the percentage of the total variation explained by the regression model. For this 
indicator, the closer in magnitude that the value is to 1, the better is the fit. All the R? 
values are very low indicating that the regression line doesn’t explain the data very well. 

The results of table 2 indicate that the regression line does not adequately explain 
the relationship between total annual O&S cost and ship-year. This means that our 
assumption that O&S costs are constant over time is plausible. The focus is now shifted 
to statistical inference and a test of the hypothesis that the slope of the regression line is 


zero. Table 3 shows the p-values of the t-test for the six submarine classes. 
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Alpha = 0.05 
Robust Regression Significant 
(Cost~ Year) (slope different from zero) 
-value 





Table 3. t-Test Results. The results of the t-test indicate that there 
appears to be a relationship between total annual O&S cost and ship-year 
for four classes, but this relationship is weak and can in some part be 
accounted for by the decrease in DDC for retiring classes. 


The results of the t-test (Table 3) indicate that there appears to be a relationship 
between total annual O&S cost and ship-year for four classes. Of these four classes, they 
all show a decreasing cost over time with the exception of the 726 class, which is 
increasing over time. There does appear to be a mild indication that total annual O&S 
cost are not constant over time. However, recalling how the extreme observations affect 
the data, how a retiring class has a sharp decrease in O&S expenditures, how small the 
regression slopes are and that the largest R~ value is less than 18%, it is reasonable to 


conclude that O&S costs are approximately constant from year to year. 


6. Data Analysis Conclusion 


The original assumption that total annual O&sS costs are constant over time 1s not 
unreasonable despite evidence of a mild relationship between cost and time. These 
relationships are characterized in OSD CAIG as the phase in period, steady-state period 
and the phase-out period. The phase-in period was seen in the SSBN 726 class, the 
steady-state period was seen in the SSN 688 class and the phase-out period was seen in 
the other classes. It should be noted that where a trend appears, the cost-time relationship 
is negative with the exception of the 726 class, meaning O&S cost are decreasing over 
time for the steady-state period and the phase-out period. Given that the original 
assumption, which was that O&S cost are constant over time, is not invalid, development 


of the cost model proceeds with class average data. 
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Me FORMULATION OF THE COST MODEL 


A. DEVELOPING THE COST ESTIMATING RELATIONSHIPS 


Three parameters related to the size of the submarines, submerged displacement 
(tons), length overall (LOA) in feet, and manpower (crew), are designated as the 
independent variables and annual O&S cost as the dependent variable. For each of the 
thirteen submarine classes submerged displacement, LOA and crew data was collected 
(Jane’s Fighting Ships, 1986-93). The assumption is that as these variables increase, 
O&sS costs will increase. For example, as crew size increases total O&S costs will 
increase. OLS regression is employed to test this assumption using an o-level of 
significance equal to 20 percent®. The use of robust regression would be appropriate in 
this part of the analysis but since the robust results are approximately the same as OLS, 
OLS is used. 

Typically, a point estimate of O&S cost for each class would constitute the O&S 
cost data for the regression. The point estimate would naturally be the class’s average 
annual O&S cost. The OLS regression would then be conducted on 10 data points or 
observations comprised of the average O&S cost for each class of submarine in the SSN 
category and 3 data points or observations comprised of the average O&S cost for each 
class of submarine in the SSBN category. A point estimate from any of the classes 
defines the average exactly but says nothing of the variance around the average (recall the 
scatter plots). By applying a point estimate, information on how O&sS costs vary is 
ignored. As was shown earlier, there is much variability in O&S costs. A better 
approach js to use all the information that each class provides, the average and the spread 
around the average. Because it was demonstrated earlier that no submarine is 
distinguishable from another submarine with in its class, it is reasonable to treat each 
O&S observation within a class as an independent observation. 

A multivariate cost model could be problematic as an estimator of total annual 
O&sS cost due to the suspected statistical correlations that exist between the independent 


variables. To investigate this a correlation matrix was calculated for the independent 


° This is the standard level used by analysts in the DOD cost community. 


Ze 


variables (Table 4). The DOD cost-estimating community commonly accepts that 


correlation values greater than or equal to 70 percent indicate multicollinearity may exist. 





Table 4. Matrix of r-Values for Three Parameters of Submarine 
Size (SSN). The correlation matrix for SSBNs is similar. 


Although all the parameters are statistically dependent, given that their respective 
r-values exceed 80 percent, this study will consider both multivariate and univariate 
models for completeness. The correlation matrix for SSBNs is similar. 

The data analysis chapter highlighted six of the twelve submarine classes used in 
the study. They were selected to demonstrate the process of visual analysis in validating 
the assumption that O&S cost are constant across time for any class of submarine. The 
other six SSN classes made up less than seven percent of the total SSN population and 
showed similar statistics. This chapter will include all twelve classes in their respective 
category for the CER analysis. 

Graphical analysis of categorical (SSN and SSBN) O&S costs versus size for each 
class reveals no indication of a close functional relationship for the univariate model (see 
Figures 10 and 11). The regression lines on the plots indicate that the slopes of all the 
lines are zero or near zero meaning little change in O&S cost when varying the predictor. 
The R’ values show that little to no variation in the data is explained in the model. This 
indicates that there is no CERs between the three size parameters used and annual O&S 
costs. Table 5 shows how well the OLS regression lines fit the data. The table 
introduces a measurement called the coefficient of variation (CV) which is the ratio of the 
SE to the sample mean. CV is a measure of the percentage by which, on average, the 


cost prediction will be off from the actual value; thus, a smaller CV implies a better fit. 
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SSN O&S Cost Modeled by Crew Size 
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Figure 10. SSNs OLS Regression for O&S Cost Modeled by Three Size Parameters. The 
regression lines of the three plots reveals no indication of a close CER between O&S cost and 
submarine size parameter. All R” are less than .001, see table 5 for regression results. Additionally, 
both multiple linear and log-linear modeling was conducted and analyzed but produced similar 
results (see Appendix B for regression results). This indicates that there is no statistical relationship 


between the three size parameters and annual O&S costs. 
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Figure 11. SSBNs OLS Regression for O&S Cost Modeled by Three Size Parameters. 
The regression lines of the three plots reveals no indication of a close CER between O&S 
cost and submarine size parameter. All R’ are less than .03, see table 5 for regression results. 
Additionally, log-linear modeling was conducted and analyzed but produced similar results 
(see Appendix B for regression results). This indicates that there is no statistical relationship 
between the three size parameters and annual O&S costs. 
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Table 5. OLS Regression results From O&S Cost Modeled by Three Size Parameters. The regression 
lines on the plots indicate that the slopes of all the lines are zero or near-zero meaning little change in O&S 
cost when varying the predictor. The R’ values show that little to no variation in the data is explained in the 
model. This indicates that there is no statistical relationship between the three size parameters and annual 
O&S costs. The SSN and SSBN CERs explain nothing of O&S costs regardless of the parameter used and 
the zero slope regression line indicates that O&S costs for all classes in a category, SSN or SSBN, are 
Statistically the same. 


The SSN CERs explain virtually nothing of annual O&S costs regardless of the 
parameter used and the zero slope regression line indicates that annual O&S costs for all 
SSNs are statistically the same regardless of class. The SSBN CERs also explain very 
little of O&S costs even though the slope of the regression line is not quite zero. 
However, it is near zero and does not help model annual O&S cost based on size 
parameters. 

In addition to the above traditional linear regression analysis using a single 
predictor, both multiple linear regression analysis and log-linear regression analysis was 
conducted. Multiple linear regression was not conducted on the SSBN category because 
the three classes in the category have only two different values for each size parameter. 
SSBN 616 and 640 share the same crew size, LOA and tonnage. The statistics from the 
analysis indicate that the multiple linear and log-linear models both failed to reveal CERs 
between the three size parameters used and annual O&S costs. The statistics from the 
analysis is presented in Appendix B. 

The revelation that annual O&S costs are approximately the same for any class 
within a category may not seem as strange as it appears. For a conventional powered 
submarine (non-nuke) the amount of diesel fuel used to propel it would be greatly 


affected by length and displacement. Fuel is a major factor in annual O&S costs for non- 
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nuclear boats. This fuel must be replenished continuously and thus charged against the 
boat’s O&S cost continuously. For a nuclear powered boat the fuel can be considered as 
a built-in fuel packet with a set lifetime. The cost of this initial fuel packet is not charged 
against the boat’s annual O&S cost and nuclear fuel is not replenished continuously but 
discretely. Not all boats are refueled during their lifetime, but the ones that are have an 
extraordinarily high direct depot maintenance cost component and are observed as some 
of the extreme observations seen earlier in the data analysis chapter. So we see that the 
initial cost of fuel is not distributed over the years leading up to a scheduled overhaul 
with a refueling or decommissioning. Also, when a boat is refueled, it experience a one- 
time charge against its O&S cost, which will be categorized as an extreme observation. 
If initial outfitting of reactor cores are charged in the submarines construction phase and 
reactor cores last the lifetime of the boat, it is possible that the variability in O&S cost my 
be reduced significantly to where only fleet modernization cost would drive the variance 
in total O&S cost. 

The assumption that annual O&S cost was related to size parameters was the basis 
of the O&S cost model. With evidence to the contrary, the focus will shift to analysis of 
the actual cost distribution for SSNs and SSBNs. Examining the cost distributions is an 


alternate way to estimate annual O&S costs based on probabilistic assessment. 


B. O&S COST DISTRIBUTION AND CUMULATIVE DISTRIBUTION 


i. O&sS Cost Distribution and Cumulative Distribution 


Because submarine O&S costs are nearly constant over all classes within the SSN 
and SSBN categories and can’t be modeled with CERs, the distribution of the actual cost 
data for each category will be analyzed. Through O&S cost distributions and cumulative 
distributions, decision-makers will have a tool for probabilistic assessment of new 
submarine acquisition programs. 

The distribution of total annual O&S costs for SSN and SSBN categories are 
displayed in the upper graphs of Figures 12 and 13 and show the relative likelihood of 
cost falling into different cost ranges. The cost ($M) under each bar represents the right 


edge of that bar. The figures show how annual O&sS costs are distributed according to 
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Figure 12. SSN Annual O&S Cost Distribution and Cumulative Distribution. An alternate 
approach to estimating SSN annual O&S Cost is through probabilistic assessment. The O&S cost 
distribution shows that just under 80% of all O&S cost observations are below $24 M annually. The 
cumulative cost distribution shows that 90% of all actual annual O&S cost observations are below 
$73 M, and that 10% of all actual observations are above $73 M. The table at the bottom summarizes 
the 50™ through 100" percentile of total annual O&S cost. 
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Figure 13. SSBN Annual O&S Cost Distribution and Cumulative Distribution. An alternate 
approach to estimating SSBN annual O&S Cost is through probabilistic assessment. The O&S cost 
distribution shows that 60% of all actual O&S cost observations are below $32 M annually. The 
cumulative cost distribution shows that 90% of all actual annual O&S cost observations are below 
$90 M, and that 10% of all observations are above $90 M. The table at the bottom summarizes the 
50" through 100" percentile of total annual O&S cost. 
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their frequency of occurrence. The frequency of occurrence is expressed as a percentage 
along the vertical axis and the annual O&S cost along the horizontal axis. 

The cumulative distribution of the annual O&S costs provides a probabilistic 
assessment tool to aid in cost estimation. The cumulative distributions in Figures 12 and 13, 
along with their associated tables of percentiles, display the cumulative probability that 
annual O&S cost will be less than or equal to a specified amount for SSNs and SSBNs. The 
cumulative distribution curves can be read by specifying a probability for which one wants 
to bound one’s cost estimate, and then reading off the corresponding estimate for annual 
O&sS cost. For example, if a decision maker or cost analyst desires an SSN annual O&S 
cost estimate for which the probability is 80 percent that the true annual O&S cost will not 
exceed the estimate, then, looking at Figure 12, the analyst would find 80 percent on the 
vertical axis and read off approximately $27 M on the horizontal axis. The interpretation is 
that, historically, 80 percent of all SSNs have experienced annual O&S costs of no more 
than $27 M, while 20 percent of SSNs experienced higher annual costs. Or, loosely, the 
analyst can be about 80 percent confident that annual O&S costs for the new submarine will 
not exceed $27 M. Similarly, suppose one wants a cost estimate for which the probability is 
90 percent that the true annual O&S cost will not exceed the estimate. This time the analyst 
would find 90 percent on the vertical axis and read off approximately $73 M on the 
horizontal axis. Again, the interpretation 1s that, historically, 90 percent of all SSNs 
experienced annual O&S costs less than or equal to $73 M, while 10 percent of all SSNs had 
annual O&S cost greater than $73 M. The percentile table in Figure 12 and 13 simplify this 
lookup for selected cumulative probabilities. 

It is worthwhile pointing out that points along those segments of the cumulative 
distribution curve which tend to the vertical have relatively small variance, while points 
along the those segments which tend to the horizontal have significantly larger variance. 

In addition, the cumulative distribution of the four major O&S cost components 
for both SSNs and SSBNs are also broken out and listed in Appendices E and F. These 
are given in the event that one desires to estimate submarine annual O&S costs at the 


O&S sub-component level. 
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VI. CONCLUSIONS AND RECOMMENDATION 


The assumption that submarine annual O&S costs could be estimated using simple 
predictors such as crew size, length overall and submerged displacement was shown to be 
invalid. The results of the analysis showed that the annual O&S costs are roughly the same 
across all classes within a category, SSN or SSBN. However, the analysis also showed that 
extreme annual O&S cost observations are common and that these extreme observations 
tend to be driven by depot maintenance costs. 

With the failure of the parametric models, an alternative method of estimating 
annual O&S cost was developed using probabilistic assessment of cost based on the 
empirical annual O&S cost distribution. Although the process lacks precision, it provides 
bounded cost estimates based on 14 years worth of real O&S cost data. The probabilistic 
assessment method allows decision makers and cost analysts to estimate the annual O&S 
cost for which there is a desired probability that the true annual O&S cost of a new 
submarine will not be exceeded. For example, analysts can determine that, historically, 80 
percent of all SSNs have experienced annual O&S costs of less than $27 M (CY99$), while 
the remaining 20 percent have experienced annual O&S costs greater than $27 M (CY99$). 
So, loosely speaking, one can be approximately 80 percent confident that the annual O&S 
cost of a newly acquired SSN will be no more than $27 M (CY99$). Similar results can be 
obtained for any SSN or SSBN, and for any desired probability. 

Further investigation is recommended to gain insight into the specific causes of the 
extreme annual O&S cost observations. A better understanding of their causes could affect 
acquisition strategy and possibly reduce the variance in annual O&S costs, which would 


ultimately improve the ability to estimate annual O&S cost of new submarines. 
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APPENDIX A. SAMPLE OF RAW VAMOSC-ISR DATA 


BARRELS (BBLS) FUEL PER STEAMING = SSN-671 


HOUR UNDERWAY 


NO. OF ENLISTED PERSONNEL - MARINE SSN-671 


NO. OF ENLISTED PERSONNEL - NAVY 


NO. OF OFFICER PERSONNEL - MARINE 


NO. OF OFFICER PERSONNEL - NAVY 
NO. OF SHIPS 

STEAMING HOURS NOT UNDERWAY 
STEAMING HOURS UNDERWAY 
DIRECT UNIT COSTS 


PERSONNEL 

MANPOWER 

REPORTED MAINTENANCE LABOR 
MANHOURS 

OFFICER MANPOWER 

ENLISTED MANPOWER 
TEMPORARY ADDITIONAL DUTY (TAD) 
MATERIAL 

SHIP PETROLEUM, OIL AND 
LUBRICANTS (POL) 

FUEL (FOSSIL) 

FUEL UNDERWAY 

FUEL NOT UNDERWAY 

OTHER PETROLEUM, OIL AND 
LUBRICANTS (POL) 

BARRELS OF FUEL CONSUMED 
UNDERWAY 

NOT UNDERWAY 

REPAIR PARTS 

SUPPLIES 
EQUIPMENT/EQUIPAGE 
CONSUMABLES 

SHIPS FORCE MATERIAL 
TRAINING EXPENDABLE STORES 
AMMUNITION 

OTHER EXPENDABLES 
REPAIRABLES 

ORGANIZATIONAL EXCHANGES 
ORGANIZATIONAL ISSUES 


*" PURCHASED SERVICES 


PRINTING AND REPRODUCTION 


SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 


SSN-671 
SSN-671 
SSN-671 


SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 


SSN-671 
SSN-671 
SSN-671 
SSN-671 


SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 
SSN-671 


ADP RENTAL AND CONTRACT SERVICES SSN-671 


RENT AND UTILITIES 
COMMUNICATIONS 
OTHER 


DIRECT INTERMEDIATE MAINTENANCE 


AFLOAT MAINTENANCE LABOR 
AFLOAT MAINTENANCE LABOR 
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SSN-671 
SSN-671 
SSN-671 
SSN-671 


SSN-671 
SSN-671 


NARWHAL 


NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 


NARWHAL 
NARW HAL 
NARWHAL 


NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 


NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 


NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARW HAL 
NARWHAL 
NARW HAL 
NARWHAL 
NARW HAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARW HAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 
NARWHAL 


NARWHAL 


NARWHAL — 


1984 
0 


0 

125 

0 

15 

1 

192 

2,860.00 
7,233,143.00 


4,690,610.00 
4,666,473.00 
4,807.00 


874,502.00 
3,/91,971.00 
24,138.00 
2,288,133.00 
27,809.00 


15,244.00 
12,042.00 

3,202.00 
12,564.00 
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652,563.00 
270,882.00 
37,434.00 
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50,772.00 
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4,863.00 

0 
1,332,016.00 
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0 

2en7 1.00 
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3.1.1.3.3 
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MANHOURS 
ASHORE MAINTENANCE LABOR 
ASHORE MAINTENANCE LABOR 
MANHOURS 

MATERIAL (DIM) 

AFLOAT REPAIR PARTS 

ASHORE REPAIR PARTS 
COMMERCIAL INDUSTRIAL SERVICES 
DIRECT DEPOT MAINTENANCE 


SCHEDULED SHIP OVERHAUL 
REGULAR OVERHAUL 
PUBLIC SHIPYARD (ROH) 
OVERHEAD (ROH PUBLIC) 
LABOR (ROH PUBLIC) 
MANDAYS (ROH PUBLIC) 
MATERIAL (ROH PUBLIC) 
PRIVATE SHIPYARD (ROH) 
SHIP REPAIR FACILITY (ROH) 
OVERHEAD (ROH SRF) 
LABOR (ROH SRF) 

MATERIAL (ROH SRF) 
SELECTED RESTRICTED AVAILABILITY 
(SRA) 

PUBLIC SHIPYARD (SRA) 
OVERHEAD (SRA PUBLIC) 
LABOR (SRA PUBLIC) 
MANDAYS (SRA PUBLIC) 
MATERIAL (SRA PUBLIC) 
PRIVATE SHIPYARD (SRA) 
SHIP REPAIR FACILITY (SRA) 
OVERHEAD (SRA SRF) 
LABOR (SRA SRF) 

MATERIAL (SRA SRF) 
NONSCHEDULED SHIP REPAIRS 
RESTRICTED AVAILABILITY 
PUBLIC SHIPYARD (RAV) 
OVERHEAD (RAV PUBLIC) 
LABOR (RAV PUBLIC) 
MANDAYS (RAV PUBLIC) 
MATERIAL (RAV PUBLIC) 
PRIVATE SHIPYARD (RAV) 
SHIP REPAIR FACILITY (RAV) 
OVERHEAD (RAV SRF) 
LABOR (RAV SRF) 

MATERIAL (RAV SRF) 
TECHNICAL AVAILABILITY (TAV) 
PUBLIC SHIPYARD (TAV) 
OVERHEAD (TAV PUBLIC) 
LABOR (TAV PUBLIC) 
MANDAYS (TAV PUBLIC) 
MATERIAL (TAV PUBLIC) 
PRIVATE SHIPYARD (TAV) 
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SSN-671 
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NARW HAL 
NARWHAL 
NARW HAL 
NARW HAL 
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3.4.1.3 
3.4.2 
3.4.3 
3.4.3.1 
3.4.3.2 


3.4.3.3 
3.4.4 
3.4.5 


3.4.5.1 
3.4.5.2 
4.0 
4.1 

4.2 
4.3 


4.4 
9.0 


SHIP REPAIR FACILITY (TAV) 
OVERHEAD (TAV SRF) 

LABOR (TAV SRF) 

MATERIAL (TAV SRF) 

FLEET MODERNIZATION 

PUBLIC SHIPYARD (FM) 
OVERHEAD (FM PUBLIC) 

LABOR (FM PUBLIC) 

MANDAYS (FM PUBLIC) 

MATERIAL (FM PUBLIC) 

PRIVATE SHIPYARD (FM) 

SHIP REPAIR FACILITY (FM) 
OVERHEAD (FM SRF) 

LABOR (FM SRF) 

MATERIAL (FM SRF) 
CENTRALLY-PROVIDED MATERIAL 
OTHER (FM) 

OUTFITTING AND SPARES 

OTHER DEPOT 

NAVAL AVIATION DEPOT (NADEP) 
OVERHEAD (NADEP) 

LABOR (NADEP) 

MATERIAL (NADEP) 

FIELD CHANGE INSTALLATION 
REWORK 

ORDNANCE REWORK 

HULL, MECHANICAL AND ELECTRICAL 
REWORK (HME) 

ELECTRONIC REWORK 

DESIGN SERVICES ALLOCATION 
PERA, SUBMEPP PLANNING AND 
PROCUREMENT 

PERA, SUBMEPP PLANNING 

PERA, SUBMEPP PROCUREMENT 
INDIRECT OPERATING AND SUPPORT 


TRAINING 

PUBLICATIONS 

ENGINEERING AND TECHNICAL 
SERVICE (ETS) 

AMMUNITION HANDLING 
TOTAL 
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APPENDIX B. MULTIPLE LINEAR AND LOG-LINEAR REGRESSION 
ANALYSIS 


Multiple Linear Regression Results (None for SSBN category) 
1. SSN 


a. O&S cost ~ Crew + LOA + Ton 


Crew 


LOA 
Ton 
Intercept ($M) 








i “Ve | 0.00295 
f-statistic / p-value 1.186 / .313 
Significant Alpha = .20 No 






b. O&S cost ~ Crew + LOA 


Tope GMO] SESM 


Crew .059 116 210 .610 
LOA -.018 041 -.439 .660: 
Intercept ($M) 24.05 7.486 3.212 O01 
















eae i 0002 
130 /_.878 
Significant Alpha = .20 
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c. O&S cost ~ Crew + Ton 


lope GM] SE GN 


Crew 
Ton 
Intercept ($M) 










i ——a 0001 
094 /_.910 
Significant Alpha = .20 No 





d. O&S cost ~ Ton + LOA 


Predictors Slope ($M)| SE($M) | t-stat -value 
Pp 


Ton .006 .003 1.875 .060 
LOA -.180 .098 -1.832 .067 
Intercept ($M) 48.578 14.271 3.403 



















TRG ae na 0029 
1.76 / .1726 
Significant Alpha = .20 





Log-Linear Regression Results 
1. SSN 


a. In(O&S cost) ~ In(Crew) + In(LOA) + In(Ton) 


Predictors 


In(Crew) 
In(LOA) 
In(Ton) 

Intercept 











4.476 / .004 
Significant Alpha = .20 
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b. In(O&S cost) ~ In(Crew) + In(LOA) 


Predictors 










In(Crew) 468 324 1.446 .148 
In(LOA) -.340 Beas -1.036 


Intercept 22575 1.065 2.419 





[Ri a 0018 
f-statistic / p-value 1.087 / .3376 
Significant Alpha = .20 





c. In(O&sS cost) ~ In(Crew) + In(Ton) 


In(Crew) -.062 331 -.187 
In(Ton) .169 SS NW 
Intercept) 1.684 915 1.840 


aS ae 0016 
f-statistic / p-value .965 / .38]1 
Significant Alpha = .20 





d. In(O&S cost) ~ In(Ton) + In(LOA) 


In(Ton) 1.203 3 | 3.624 
In(LOA) -2.016 599 -3.362 é 
Intercept 4.103 1.144 3.586 


6.611 / .001 
Significant Alpha = .20 
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e. In(O&S cost) ~ In(Crew) 













Predictors | Slope | stat | Stat | p-value 


>. a. ses mm 048 om 
Intercept 1.941 870 2230 025 









p-value 


Significant Alpha = .20 ee 


f. In(O&S cost) ~ In(LOA) 
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2. SSBN 


a. In(O&S cost) ~ In(Crew) 


In(Crew) 2.917 938 3.107 .002 
Intercept -13.13 545 -2.457 O14 
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b. In(O&S cost) ~ In(LOA) 


In(LOA) .705 wyay AE 3.107 .002 
Intercept -.863 1.396 -0.618 536 
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c. In(O&S cost) ~ In(Ton) 
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APPENDIX C. SSN COMPONENT ANNUAL O&S COST DISTRIBUTIONS 


Direct Unit Cost Distribution 
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APPENDIX D. SSBN COMPONENT ANNUAL O&S COST DISTRIBUTIONS 


Direct Unit Cost Distribution 
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APPENDIX E. SSN COMPONENT ANNUAL O&S COST CUMULATIVE 
DISTRIBUTIONS 


Direct Unit Cost Cumulative Distribution 
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